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(54) NEWS SUPPORTING SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a news 
supporting system where a mobile object and a ground 
station can take out what each of structures picked up 
by a camera is and instantaneously take out various 
information concerning the respective structures. 
SOLUTION: A camera position, a camera angle, a focal 
distance and a picture size when a picture picked up 
from a camera on a mobile terminal 1A is inputted are 
acquired by a camera attribute information acquirement 
part 1 3. The name of a structure which is to be viewed 
in a CG picture based on them is acquired by a map 
information management part 14. The name of the 
structure is superimposed on the acquired picture and it 
is displayed on a visual unit. Acquired camera attribute 
information is sent to a ground station center 2A and 
the name of the structure is similarly acquired based on 
information. The acquired name of the structure is 
superimposed on the picture and it is displayed on a 
television or the like. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] It is the report support system which consists of a mobile terminal and an earth station 
pin centerjarge. Said mobile terminal An image acquisition means to acquire an image, and a 
positional information acquisition means to acquire the camera location at the time of image 
acquisition, A camera attribute information acquisition means to acquire the camera angle, the 
focal distance, and image size at the time of image acquisition, The 1st map information 
management means which manages map information and gains the name of the structure which 
asks for visual field space in map information space based on the camera location and camera 
angle which were acquired, a focal distance, and image size, and exists all over the visual field 
space, The 1st label information creation means which creates label information including the 
name and/or its related information, and the grant location of said gained structure, A labeling 
information output means to superimpose a structure name on the location in said image 
corresponding to the positional information in the created label information, and to output the 
image on which it was superimposed to a vision device, and/or to output the related information 
of a structure name to a vision device, The 1st means of communications which transmits said 
photoed image, said camera location of image photography time of day, said camera angle, said 
focal distance, and image size to said earth station pin centerjarge, The mobile terminal control 
means which controls each above-mentioned means is included. Said earth station pin 
centerjarge The 2nd means of communications which receives said image, said camera location 
of image photography time of day, a camera angle, said focal distance, and said image size from 
said mobile terminal, The 2nd map information management means which manages map 
information and gains the name of the structure which asks for visual field space in map 
information space based on the camera location and camera angle which were acquired, a focal 
distance, and image size, and exists all over the visual field space, After the 2nd label information 
creation means which creates label information including said gained structure name and/or its 
related information, and a grant location, A report support system including the 2nd labeling 
information output means which superimposes a structure name and/or its related information 
on the location in said image corresponding to the positional information in the created label 
information, and outputs the image on which it was superimposed to a vision device, and the 
earth station pin centerjarge control means which controls each above-mentioned means. 
[Claim 2] It is the report support system which consists of a mobile terminal and an earth station 
pin centerjarge. Said mobile terminal An image acquisition means to acquire an image, and a 
positional information acquisition means to acquire the camera location at the time of image 
acquisition, A camera attribute information acquisition means to acquire the camera angle, the 
focal distance, and image size at the time of image acquisition, Said photoed image, said camera 
location of image photography time of day, a camera angle, a focal distance, image size, and the 
1st means of communications that transmits to an earth station pin centerjarge, The mobile 
terminal control means which controls each above-mentioned means is included. Said earth 
station pin centerjarge The 2nd means of communications which receives said image, said 
camera location of image photography time of day, said camera location, said camera angle, said 
focal distance, and said image size from said dynamic body terminal, A map information 
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management means to manage map information and to gain the name of the structure which 
asks for visual field space in map information space based on the camera location and camera 
angle which were acquired, a focal distance, and image size, and exists all over the visual field 
space, A label information creation means to create label information including said gained 
structure name and/or its related information, and a grant location, A labeling information output 
means to superimpose a structure name on the location in said image corresponding to the 
positional information in the acquired label information, and to output the image on which it was 
superimposed to a vision device, and/or to output the related information of a structure name to 
a vision device, A report support system including the earth station pin centerjarge control 
means which controls each above-mentioned means. 

[Claim 3] It is the report support system which consists of a mobile terminal and an earth station 
pin centerjarge. Said mobile terminal An image acquisition means to acquire an image, and a 
positional information acquisition means to acquire the camera location at the time of image 
acquisition, A camera attribute information acquisition means to acquire the camera angle, the 
focal distance, and image size at the time of image acquisition, A map information management 
means to manage map information and to gain the name of the structure which asks for visual 
field space in map information space based on the camera location and camera angle which were 
acquired, a focal distance, and image size, and exists all over the visual field space, A label 
information creation means to create label information including said gained structure name 
and/or its related information, and a grant location, A labeling information output means to 
superimpose a structure name on the location in said image corresponding to the positional 
information in the acquired label information, and to output the image on which it was 
superimposed to a vision device, and/or to output the related information of a structure name to 
a vision device, The 1st means of communications which transmits the related information of the 
image with which it was superimposed on the structure name, and/or a structure name to an 
earth station pin centerjarge, Said earth station pin centerjarge is a report support system 
including the image with which it was superimposed on the structure name, the 2nd means of 
communications which receives the related information of a structure name from said mobile 
terminal, and the earth station pin centerjarge control means which controls each above- 
mentioned means including the mobile terminal control means which controls each above- 
mentioned means. 

[Claim 4] A communication link address storage means to memorize the communication link 
address of the communication device relevant to said structure name, If the location on the 
screen of said vision device is instructed to be a communications processing means to set up a 
communication path with said communication link address to a user It asks for the 
communication link address of said communication device relevant to said structure name 
corresponding to the directed screen location from said communication link address storage 
means. A report support system given in any 1 term of claims 1-3 which have the group of a 
screen tab-control-specification means which passes said communication link address for which 
it asked to said communications processing means in said mobile terminal or said earth station. 
[Claim 5] Said label information creation means is the system of four given in any 1 term from 
claim 1 which creates CG image which is a computer graphics image based on the gained 
structure, asks for the structure of the subregion which was matched and was matched with the 
subregion in said CG image by pattern matching to said subregion of said image, and creates 
label information including the name or the attribute information, and the grant location of the 
structure. 

[Claim 6] Said label information creation means carries out three-dimension projection 
conversion of the gained structure on a camera screen. Eliminate the structure which does not 
appear from a view, create CG image, and the border line of the subregion in CG image divides 
CG image into subregion. Said subregion of said image and said subregion of said CG image are 
matched with pattern matching. The system of four given in any 1 term from claim 1 which asks 
for the structure which became the radical of the subregion of a matching CG image to the 
subregion of an image, and creates label information including the name or the attribute 
information, and the grant location of the structure. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the system which reports on television etc. the 
image photoed by the image photography equipment carried in transportation means, such as a 
HEL and an airplane. 
[0002] 

[Description of the Prior Art] When accidents , such as natural disasters , such as a fire and an 
earthquake , and explosion , a m^jor accident , occur , the press , such as TV station and a 
newspaper publishing company , dispatch a HEL , an airplane , and a car in a site , a reporter 
explain a damage situation from the locations ( sky etc. ) which can overlook a site , or after it 
transmit the image from the on-site sky to studio , it be explain the situation based on the image 
to which the newscaster be transmitted . 
[0003] 

[Problem(s) to be Solved by the Invention] However, the reporter in a HEL etc. does not 
understand correctly the matter said some [ what the building by which it was damaged, and the 
structure are, and the exact name of a place of the location ]. Moreover, though a map is carried 
in in a HEL, comparing the map of paper and the image under one's view, and matching a building 
takes time and effort too much, and it is also inaccurate. Or in the case of the situation and 
Nighttime when a field of view is bad, matching may take time amount still more, matching may 
become incorrectness more, or it may hardly be visible primarily. For this reason, reporters have 
to broadcast the situation of a site live to the basis of uncertain situation recognition, and real 
time on television. Although the viewer of television including people who live around the disaster 
prevention persons concerned or the stricken area wants to grasp an exact situation 
immediately, and the rough situation can be held by the reporter junction in television, the thing 
of finer level cannot be understood. For example, the crossing when the building out of which the 
smoke of middle of the screen has come is showing with the image as for some of what buildings 
and address names of those cannot explain a crossing of what and the matter of ** to the 
reporter who is on the helicopter etc. correctly early. Of course, there is no way for which a 
reporter gets to know immediately detail data required only for specific people of [ resident / of 
the building out of which smoke has come / telephone number / of whom and its resident ] No. a 
number of in the telephone number of the contact of the family of No. a number of and the 
resident of those. It is necessary to, carry out the radio transmission of the image once photoed 
by HEL etc. to the editorial office of a terrestrial television station on the other hand, and to 
carry out a reorganization collection by the terrestrial television station side, and a newscaster 
needs to explain. 

[0004] Therefore, each structure in the image photoed with the camera is what, or the purpose 
of this invention has taken out various information about each structure further in an instant to 
offer a possible report support system in the earth station within a mobile. 
[0005] 

[Means for Solving the Problem] In this invention, the map data on a computer are beforehand 
created as three-dimension data. The image photoed with the camera from the mobile (in order 
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to distinguish from CG image, it is called a scene image below.) The location, the include angle, 
the focal distance, and image size of the camera when being inputted are acquired at the time of 
photography. The name of the structure which should appear in computer three-dimension map 
space by CG image based on the location, the include angle, the focal distance, and image size of 
the camera at the time of image photography is acquired. The acquired structure name is first 
indicated by superposition by the vision device at a scene image, and the related information 
about the structure name on which it was superimposed is displayed on a vision device. In that 
case, the related information about a structure name and it may be displayed, and it may divide 
into another vision device and you may display on the same vision device. Furthermore, the 
location, the include angle, the focal distance, and image size of a scene image and the camera in 
scene image photography time of day are transmitted to an earth station with photography time 
of day. In an earth station, the location, the include angle, the focal distance, and image size of 
the camera in the scene image and photography time of day according to photography time of 
day are received from a mobile, the structure name which must be visible in computer three- 
dimension map space based on it with CG image is acquired, the acquired structure name is first 
indicated by superposition by the vision device at a scene image, and the related information 
about the structure name on which it was superimposed is displayed on a vision device. About 
the notation in a vision device, it is the same as that of the method in a mobile. 
[0006] Here, superposition of a structure name and presenting of the related information may be 
performed only by the mobile, and you may carry out only in an earth station. For this reason, 
without performing superposition of a structure name, and presenting of that related information, 
you may constitute from a mobile so that superposition of a structure name and presenting of 
that related information may be performed only in the earth station pin center.large. In that case, 
suppose that a superimposed image and related information are transmitted in the earth station 
pin centerjarge from a mobile. Superposition of a structure name and presenting of the related 
information may be performed reversely [ the ] only in an earth station, and you may constitute 
from a mobile so that superposition of a structure name and presenting of the related 
information may not be performed. 

[0007] Furthermore, the communication link address of the communication device relevant to a 
structure name is memorized in the mobile or the earth station, and if the location on the screen 
of a vision device is directed by the user, it may ask for the communication link address of the 
communication device relevant to the structure name corresponding to the directed screen 
location, and you may constitute so that a communication path with the communication link 
address for which it asked may be set up. 

[0008] Furthermore, in order to raise further the precision of matching with the structure in a 
scene image, and the structure in CG image, the structure previously gained to each subregion 
of a scene image is matched with pattern matching. CG image is created based on the gained 
structure, and it asks for the structure used as the radical of the subregion which the subregion 
in CG image was matched and was matched by pattern matching to said subregion of a scene 
image. 

[0009] Here, an example of the method of creating CG image is described. The three-dimension 
map DB is accessed based on the camera location and camera include angle which were 
acquired previously, a focal distance, and image size, and it asks for the visual field space in 
three-dimension map space. It asks for the structure in visual field space, and three-dimension 
projection conversion of the solid data of each structure is carried out by using a camera screen 
as plane of projection in this plane of projection. Furthermore, it hides in other structures among 
the line data which constitute the projection drawing form of each structure, and the hidden line 
removal of the hidden-line data is carried out using technique, such as a normal vector method. 
A hidden line removal is carried out and field division of the CG image is carried out based on 
the remaining line data. Since the three-dimension map DB is used, the name of the structure 
which serves as a radical of the field for every field can be matched. 

[0010] Then, the structure name of the subregion of CG image matched with each subregion of a 
scene image by pattern matching is extracted. Three-dimension projection conversion of the 
position coordinate of the structure in the inside of three-dimension map space is carried out in 
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previous plane of projection, and the position coordinate of the real landscape image which 
should superimpose the extracted structure name is searched for. Label information is created 
from the position coordinate of the real landscape image which should superimpose the 
extracted structure name. A structure name is superimposed on the scene image which is real 
scenery based on label information, and it displays on a vision device. 

[0011] The 1st report support system of this invention consists of a mobile terminal and an 
earth station pin centerjarge. Namely, said mobile terminal An image acquisition means to 
acquire an image, and a positional information acquisition means to acquire the camera location 
at the time of image acquisition, A camera attribute information acquisition means to acquire the 
camera angle, the focal distance, and image size at the time of image acquisition, The 1st map 
information management means which manages map information and gains the name of the 
structure which asks for visual field space in map information space based on the camera 
location and camera angle which were acquired, a focal distance, and image size, and exists all 
over the visual field space, The 1st label information creation means which creates label 
information including the name and/or its related information, and the grant location of said 
gained structure, A labeling information output means to superimpose a structure name on the 
location in said image corresponding to the positional information in the created label 
information, and to output the image on which it was superimposed to a vision device, and/ or to 
output the related information of a structure name to a vision device, The 1st means of 
communications which transmits said photoed image, said camera location of image photography 
time of day, said camera angle, said focal distance, and image size to said earth station pin 
centerjarge, The mobile terminal control means which controls each above-mentioned means is 
included. Said earth station pin centerjarge The 2nd means of communications which receives 
said image, said camera location of image photography time of day, a camera angle, said focal 
distance, and said image size from said mobile terminal, The 2nd map information management 
means which manages map information and gains the name of the structure which asks for visual 
field space in map information space based on the camera location and camera angle which were 
acquired, a focal distance, and image size, and exists all over the visual field space, After the 2nd 
label information creation means which creates label information including said gained structure 
name and/or its related information, and a grant location, The 2nd labeling information output 
means which superimposes a structure name and/or its related information on the location in 
said image corresponding to the positional information in the created label information, and 
outputs the image on which it was superimposed to a vision device, and the earth station pin 
centerjarge control means which controls each above-mentioned means are included. 
[0012] The 2nd report support system of this invention consists of a mobile terminal and an 
earth station pin centerjarge. Said mobile terminal An image acquisition means to acquire an 
image, and a positional information acquisition means to acquire the camera location at the time 
of image acquisition, A camera attribute information acquisition means to acquire the camera 
angle, the focal distance, and image size at the time of image acquisition, Said photoed image, 
said camera location of image photography time of day, said camera location, a camera angle, a 
focal distance, image size, and the 1st means of communications that transmits to an earth 
station pin centerjarge, The mobile terminal control means which controls each above- 
mentioned means is included. Said earth station pin centerjarge The 2nd means of 
communications which receives said image, said camera location of image photography time of 
day, said camera angle, said focal distance, and said image size from said dynamic body terminal, 
A map information management means to manage map information and to gain the name of the 
structure which asks for visual field space in map information space based on the camera 
location and camera angle which were acquired, a focal distance, and image size, and exists all 
over the visual field space, A label information creation means to create label information 
including said gained structure name and/or its related information, and a grant location, A 
labeling information output means to superimpose a structure name on the location in said image 
corresponding to the positional information in the acquired label information, and to output the 
image on which it was superimposed to a vision device, and/or to output the related information 
of a structure name to a vision device, The earth station pin centerjarge control means which 
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controls each above-mentioned means is included. 

[0013] The 3rd report support system of this invention consists of a mobile terminal and an 
earth station pin centerjarge. Said mobile terminal An image acquisition means to acquire an 
image, and a positional information acquisition means to acquire the camera location at the time 
of image acquisition, A camera attribute information acquisition means to acquire the camera 
angle, the focal distance, and image size at the time of image acquisition, A map information 
management means to manage map information and to gain the name of the structure which 
asks for visual field space in map information space based on the camera location and camera 
angle which were acquired, a focal distance, and image size, and exists all over the visual field 
space, A label information creation means to create label information, including said gained 
structure name and/or its related information, and a grant location, A labeling information output 
means to superimpose a structure name on the location in said image corresponding to the 
positional information in the acquired label information, and to output the image on which it was 
superimposed to a vision device, and/or to output the related information of a structure name to 
a vision device, The 1 st means of communications which transmits the related information of the 
image with which it was superimposed on the structure name, and/or a structure name to an 
earth station pin centerjarge, Said earth station pin center.large includes the image with which it 
was superimposed on the structure name, the 2nd means of communications which receives the 
related information of a structure name from said mobile terminal, and the earth station pin 
centerjarge control means which controls each above-mentioned means including the mobile 
terminal control means which controls each above-mentioned means. 
[0014] A communication link address storage means to memorize the communication link 
address of the communication device relevant to said structure name in the embodiment of this 
invention, If the location on the screen of said vision device is instructed to be a 
communications processing means to set up a communication path with said communication link 
address to a user It asks for the communication link address of said communication device 
relevant to said structure name corresponding to the directed screen location from said 
communication link address storage means, and has the group of a screen tab-control- 
specification means which passes said communication link address for which it asked to said 
communications processing means in said mobile terminal or said earth station. 
[0015] According to other embodiments of this invention, said label information creation means 
creates CG image which is a computer graphics image based on the gained structure, asks for 
the structure of the subregion which was matched and was matched with the subregion in said 
CG image by pattern matching to said subregion of said image, and creates label information 
including the name or the attribute information, and the grant location of the structure. 
[0016] According to other embodiments of this invention, said label information creation means 
Carry out three-dimension projection conversion of the gained structure on a camera screen, 
eliminate the structure which does not appear from a view, and CG image is created. The border 
line of the subregion in CG image divides CG image into subregion. It asks for the structure 
which became the radical of the subregion of a matching CG image to the subregion of matching 
and an image with pattern matching about said subregion of said image, and said subregion of 
said CG image, and label information including the name or the attribute information, and the 
grant location of the structure is created. 
[0017] 

[Embodiment of the Invention] Next, the gestalt of operation of this invention is explained with 
reference to a drawing. 

[0018] Drawing 1 is the block diagram of the report support system of the 1st operation gestalt 
of this invention. 

[0019] The report support system of this operation gestalt consists of a mobile terminal and an 
earth station pin centerjarge. 

[0020] The image acquisition section 11 which mobile terminal 1A (for example, HEL) acquires an 
image, for example, is a digital camera, The positional information acquisition section 1 2 which 
acquire the camera location at the time of acquiring an image, for example, is a GPS receiver, 
The camera attribute information acquisition section 13 which is the three-dimension electronic 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



2006/06/20 



JP,2000-050156,A [DETAILED DESCRIPTION] 



compass which acquires a camera angle, a focal distance, and image size in case an image is 
acquired, for example, was attached in the digital camera, Map information is managed with the 
image-processing section 1 0 which divides the acquired image into two or more fields. With the 
map Research and Data Processing Department 14 which ask for visual field space in map 
information space based on the location and camera angle which were acquired, a focal distance, 
and image size, and gain the name of the structure which exists all over the visual field space, 
for example, is a map DB manager The label information creation section 15 which creates label 
information including the name or its related information, and the grant location of the gained 
structure, The label information output section 1 6 which superimposes a structure name on the 
location in the image corresponding to the positional information in the acquired label 
information, and outputs the image on which it was superimposed to a vision device (un- 
illustrating), It has the photoed image, the communications processing section 17 which 
transmits said camera location, said camera angle, said focal distance, and said image size of 
image photography time of day to earth station pin centerjarge 2A, and the mobile control 
section 18 which controls each part 11-17 of the above. 

[0021] The communications processing section 21 in which earth station pin centerjarge 2A 
receives said image, said camera location of image photography time of day, said camera angle, 
said focal distance, and said image size from mobile terminal 1A, Map information is managed 
with the image-processing section 25 which divides the acquired image into two or more fields. 
With the map Research and Data Processing Department 22 which gains the name of the 
structure which asks for visual field space in map information space based on the camera 
location and camera angle which were acquired, a focal distance, and image size, and exists all 
over the visual field space Information **** 23 of the label which creates label information 
including the gained structure name or its related information, and a grant location, It consists of 
the label information output section 24 which superimposes the name of the structure, or its 
related information on the location in said image corresponding to the positional information in 
the created label information, and outputs the image on which it was superimposed to a vision 
device (not shown), and an earth station pin centerjarge control section 26 which controls each 
part 21-25 of the above. 

[0022] Reference of drawing 3 carries the GPS receiver, the gyroscope (three-dimension 
compass), and the camera in the HEL. 

[0023] Next, the flow chart of drawing 3 explains actuation of this operation gestalt to a detail. 
[0024] During the flight of mobile terminal 1 A, in order that a control section 18 may acquire the 
information about a scene image first, a processing initiation command is sent to the positional 
information acquisition section 12, the camera attribute information acquisition section 13, and 
the image acquisition section 1 1 . The positional information acquisition section 1 2 collects 
positional information per second by a GPS receiver etc. in response to an instruction from a 
control section 18, and passes it to a control section 18 (step 41). Here, not only a second unit 
but a time interval is [ how ] very good. The image acquisition section 1 1 acquires a scene image 
per second from a control section 18 in response to an instruction, and passes it to a control 
section 18 (step 41). The camera attribute information acquisition section 13 acquires the 
camera angle of scene image recording equipments, such as a camera at the time of image 
photography, in the group of a horizontal angle and an elevation angle in response to the 
instruction of a control section 18 (step 41), and if it is scene image equipment which has a 
zoom function in coincidence, it will acquire a focal distance (step 41). For every scene image 
equipment, since it is immobilization, as for image size, the control section 18 holds image size 
information. A control section 18 holds the collected information as a scene image file. 
[0025] Drawing 4 shows the file format of the DS of a scene image file. A scene image file has 
header information and image data. As header information, it has positional information, camera 
angle information, a focal distance, time information, the image size of an image file, a type, and 
size. As positional information, it has each data (for example, east longitude 1 37-degree 55 
minutes and 10 seconds, north latitude 34-degree 30 seconds of 34 minutes, altitude of 101m 
33cm, etc.) of the east longitude, the north latitude, and the altitude. As a camera angle, it has 
each data (for example, 254 horizontal-angle right-handed rotations, 1 5 elevation angles, etc.) of 
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a horizontal angle and an elevation angle. Focal distance data are the focal distances (for 
example, 28 etc.mm etc.) of the camera lens at the time of scene photography. As time 
information, it has the time of day at the time of photography (for example, Japan Standard Time 
15:06 17 etc. seconds etc. on January 31, 1997). As image size of an image file, it has pixel size 
(for example, 640x480 grade) in every direction. Similarly it has file types (a TIFE format, 8-bit 
color, etc.). Similarly it has the byte counts (307.2 etc.KB etc.) of a file. It has the image data 
itself in a binary format. 

[0026] If a control section 18 stores a scene image file, to the image-processing section 10, it 
will extract a border line from a scene image, and will order to divide a scene image into two or 
more fields. In the image-processing section 10, if it says roughly, differential processing will be 
performed based on the concentration difference in a scene image, a border line will be 
extracted, and field division will be carried out by performing labeling bordering on the border line. 
As a procedure, an image is first changed into monochrome shade image. Since a profile is a part 
into which brightness changes suddenly, it extracts a border line because perform differential 
processing and a differential value asks for a larger part than a threshold. At this time, the line 
breadth of a border line is 1 pixel, and the border line is connected. Therefore, thinning is 
performed and the connected line with a line breadth of 1 pixel is obtained. Differential 
processing and thinning are enough here, if a certain technique is used from the former. 
[0027] The obtained border line is considered to be the border line of a field, and actuation of 
numbering the field constituted by the border line is performed. The maximum number in the 
number turns into the number of fields, and the number of pixels in a field expresses the area of 
the field. The example which divided the scene image into two or more subregions is shown in 
drawing 9 . In addition, the scale of the similarity between fields (nearness) may be introduced 
and clustering processing which summarizes two or more fields in which the property is alike to 
one field may be performed. It is good also by the clustering approach like the existing approach 
throat. 

[0028] If a control section 18 makes field division processing of a scene image complete, it will 
advance the processing demand which passes the header information of a scene image file to 
the map Research and Data Processing Department 14, and performs calculation processing of 
visual field space. There is a map database program as an example of the map Research and 
Data Processing Department 14. The map Research and Data Processing Department 14 has 
managed three-dimension map data. Although two-dimensional map data are sufficient, since 
there is no height information in that case, the precision of the grant location of labeling to real 
scenery is inferior. In addition, height information is compensated and processed when carrying 
out based on two-dimensional map data. For example, if there is rank information as which a 
house expresses several stories when [ a certain ] it is two-dimensional data of a house, three- 
dimension data will be created based on the height information which multiplied rank by fixed 
numbers, presumed the height of the house, presumed to be two-dimensional data, and was 
searched for. Even when there is no rank information, it can carry out assigning a fixed number 
of height according to the area of a house graphic form etc., height information can be presumed, 
and three-dimension data are similarly created based on presumed height information. In this 
way, three-dimension data are created and processing is advanced. 

[0029] The example of three-dimension map data is shown in drawing 5 . The map information 
space expressed by two-dimensional to drawing 5 (1) is shown, and the map information space 
expressed by the three dimension to drawing 5 (2) is shown. In response to the instruction of a 
control section 18, visual field space is computed based on the header information of a scene 
image file to this three-dimension map information space in the map Research and Data 
Processing Department 14 (step 42). The example of count of visual field space is shown in 
drawing 6 . First, XY flat surface shall stretch horizontally and the Z-axis shall stretch 
perpendicularly. From the positional information in the header information of a scene image file, 
the location of View E is set up in three-dimension map information space. For example, if it is 
east longitude 137-degree 55 minutes and 19 seconds, and north latitude 34-degree 30 seconds 
of 34 minutes and the altitude of 101m 33cm, the coordinate to which it corresponds in the map 
mesh number corresponding to it will be set up. Similarly the direction of a camera angle is set 
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up based on the horizontal angle and elevation angle in the camera angle information in header 
information. Focus F is taken at the point which progressed by the focal distance from View E on 
the straight line showing the camera angle approach. The direction vector of a look is a unit 
vector of the die length 1 which comes out from View E on the straight line. The width of face x 
in the X-axis of a camera screen is set up from lateral size in the image size of a scene image 
file, and the width of face y in a Y-axis is set up from the size of a lengthwise direction. To the 
direction vector of a look, the flat surface of the width x length y is perpendicular to the 
direction of a camera angle, and it is set up so that Focus F may be included. It asks for the 
straight line which connects the point of four corners of a camera screen from the coordinate of 
View E respectively, and let three-dimension space which four halfHines prolonged from View E 
make be visual field space. The example of the visual field space in three-dimension map space 
is shown in drawing 7 . It looks at three-dimension map space from XZ flat surface. The part 
surrounded with the slash in drawing 7 is a sectional view in XZ flat surface of the space 
belonging to visual field space. In the example of drawing 7 , the building and crest in visual field 
space are included. 

[0030] Furthermore, it asks for the structure which exists in the visual field space for which it 
asked in the map Research and Data Processing Department 14. Each top-most vertices which 
constitute the stereo showing the structure calculate whether it exists in the contrant region of 
visual field space for every structure. Usually, two-dimensional map space is divided in the two- 
dimensional mesh of fixed size. The mesh of three-dimension map space cuts and, in addition to 
the mesh of the two-dimensional direction in every direction, a mesh is cut with fixed spacing 
also in the height direction as a direction. Space will be divided in the unit space of a rectangular 
parallelepiped. First, the existence of a lap part with visual field space is investigated the whole 
unit space of a rectangular parallelepiped, and it asks for the number of three-dimension unit 
map space with a lap part. The number of three-dimension unit map space here is the same as 
the so-called mesh number. To the structure in three-dimension unit map space with a lap, it 
laps with visual field space and the existence of a part is investigated. It asks for the straight line 
which connects the coordinate of top-most vertices and the coordinate of a view which 
constitute the structure, and if the straight line has an intersection to the camera screen of 
drawing 8 , it is in visual field space. If at least one top-most vertices fulfill this condition among 
two or more top-most vertices which constitute the structure, that structure shall lap with 
visual field space, and shall have a part. 

[0031] When the structure is contained inside visual field space or that part is contained, the 
processing which carries out three-dimension projection conversion of each structure in this 
plane of projection is started by using a camera screen as plane of projection. Here, as shown in 
drawing 8 , after reexpressing Point P by the system of coordinates based on View E based on a 
degree type (1), Point P is projected on a camera screen and it asks for Intersection Q. 
[0032] 
[Equation 1] 

-ly ii 0 \ /x - ex-h ixt 5 

y - ey + lyt | ■ • 'd > 
z - ez+ Izt 




(?)=(g)(; ; ) 

Coordinate vector L= of a coordinate point E=(ex, ey, ez):view of the top-most vertices which 
constitute the point P=(x y, z):structure here (Ix, ly, Iz): The direction vector of a look (unit 
vector) 

the projecting point t to the camera screen of the coordinate r= (Ix2+ly2) 1/24-point Q=(x 
y):point P at the time of expressing by the system of coordinates based on the view E of the 
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point P ,= (x', y\ and z — Opoint P searches for the field which the top-most vertices stretch for 
every structure first in focal distance three-dimension projection conversion. For example, six 
fields can be found if it is the structure expressed in a rectangular parallelepiped. In case 
projection conversion of each side is carried out on a camera screen, to each pixel on the 
camera screen included to a projection field, the distance of a view and the corresponding points 
on the field is calculated, and it stores in memory as a depth value (Z value). For every field of 
each structure, the depth value (Z value) over each pixel on a camera screen is calculated, and 
it stores in memory. In addition (formula), z ? in one expresses the depth value (Z value) from a 
view. 

[0033] In the inside of the structure by which three-dimension projection conversion was carried 
out, the structure which appears from a view, and the structure not appearing are shown in a 
camera screen. It is necessary to ask only for the structure which appears from a view in it, and 
to search for the field located from a view in the opposite side, and the field interrupted by other 
structures. Then, hidden surface elimination is performed (step 43). Although it is in the 
approach of hidden surface elimination variously, a Z buffer algorithm is used, for example. Other 
scanline algorithms and the ray tracing method are sufficient. 

[0034] The field which takes the smallest depth value for the pixel on a camera screen to the 
pixel for arbitration is searched for. Thus, if sequential processing is continued about each field 
of each structure, the field nearest to a view will be left behind for every pixel on a camera 
screen. Since the camera screen top pixel in which the field nearest to a view is determined for 
every pixel on a camera screen, and the field nearest to a view is common generally constitutes 
a field, on a camera screen, two or more fields which consist of a pixel which makes a common 
field the nearest field are made. In this way, the field which was able to be found is a field of the 
result of having carried out three-dimension projection conversion of the subregion of the 
structure which appears from a view. The field in the opposite side and the field interrupted by 
other structures are eliminated from the view. 
[0035] In this way, the made field forms CG image field. 

[0036] To the top-most-vertices coordinate of the two-dimensional graphic form which 
constitutes CG image field, the three-dimension coordinate before projection conversion is 
searched for, and it stores in memory by making both correspondence relation into a link 
information. It uses that the two-dimensional field says of which structure it is projection 
drawing based on a link information for asking etc. 

[0037] A hidden line removal is carried out and field division of the CG image is carried out 
based on the remaining line data. Since the three-dimension map DB is used, the name of the 
structure which serves as a radical of the field for every field can be matched. The field to which 
CG image was divided is numbered in order. The example which divided CG image into two or 
more subregions is shown in drawing 10 . 

[0038] If field division processing of CG image is completed, a control section 18 will order to the 
label information creation section 15 to match the division field of CG image, and the division 
field of a scene image. In the label information creation section 15, the division field of CG image 
and the division field of a scene image are matched by template matching (refer to drawing 1 1 ). 
[0039] It matches with the division field of CG image sequentially from the field (for example, No. 
1) where a number is young among the division fields of a scene image. In matching, although it is 
very good in which [ of the former to a certain matching approaches ], the simple template- 
matching method is taken here. That is, when there is a ratio of superposition and the 
overlapping part more than the fixed ratio decided as a threshold, suppose that two fields to 
compare are matched as a field about the same structure. For example, the coordinate value of 
each pixel in the field is set to (A, B) about R1 of the 1st division field of a scene image. The 
values of the pixel in a coordinate (A, B) are the interior of a field, therefore 1. In the 1st division 
field S1 of CG image, if a coordinate (A, B) becomes in a field SI, it will be the pixel value 1 and 
will lap, but if it becomes outside S1. it will be the pixel value 0 and will not lap. In this way, as a 
lap multiplier K (A, B) in a coordinate (A, B), 1 and when lapping, and not lapping, it is decided by 
0. A coordinate (A, B) is moved in a field R1 t and it asks for the lap multiplier K (A, B). several 
[ and / of the coordinate (A, B) moved in the field R1 ] — several [ of the coordinate whose lap 
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multiplier K (A, B) was 1 to N1 ] — N2 are calculated, and when N1/N2 are more than a 
threshold, the division field R1 of a scene image and the division field S1 of CG image decide on 
a thing. This matching is performed from the 1st of the division field of a scene image to the last 
thing. In addition, even if there is a location gap of some in the XY direction in addition to this as 
the matching approach, a performance index which becomes the same value may be used. 
[0040] In the label information creation section 15, after matching the subregion of CG image to 
the subregion of a scene image, the information which should be further superimposed for every 
subregion of a scene image is searched for, and the processing (step 44) which creates as label 
information with the location which should be superimposed is started. First, the subregion of 
corresponding CG image is taken out to the subregion of a scene image. The subregion of taken- 
out CG image carries out three-dimension projection conversion of the field which has a three- 
dimensional structure object in three-dimension map space from the first to a camera screen, 
and is obtained. Then, the depth value (Z value) in which the subregion of CG image has the field 
of the three-dimensional structure object used as the radical of three-dimension projection 
conversion is calculated as a key. When three-dimension projection conversion is carried out 
previously, the created link information may be used as a key. Based on the field of the structure 
used as a basis, the three-dimension map DB is accessed and the name or attribute information 
on the structure is acquired. If attribute information is the information which means the 
information which accompanies about the structure and starts the structure here, it is good 
anything. And the position coordinate which should superimpose a name or attribute information 
is decided to the subregion of a scene image. How to determine may determine how. For 
example, the center of figure which stretches subregion is sufficient. Label information is created 
from the name or the attribute information, and the grant position coordinate of the structure. 
The example of label information is shown in Table 1. 
[0041] 
[Table 1] 





msmt 






(3 0 0, 5 0 0) 


1 0 




(4 5 0, 2 5 0) 


1 0 




(1 5 0, 2 0 0) 


1 2 



The label information creation section 15 will pass label information to a control section 18, if it 
finishes creating label information. 

[0042] If label information is received, a control section 18 will order that a display etc. outputs 
by carrying out label information to a vision device to the label information output section 16. 
Here, a vision device contains graphic display devices, such as a display and a head mount 
display. The name or attribute information on the structure in label information is superimposed 
on the location in a scene image, and the scene image on which it was superimposed is 
outputted to a graphic display device (step 45). The example of the scene image with which it 
was superimposed on label information is shown in drawing. 

[0043] The label information output section 1 6 will notify the completion of an output to a 
control section 18, if label information is outputted. It is directed that a control section 18 will 
transmit the image, the camera location of image photography time of day and camera angle 
which were photoed to the communications processing section 17, a focal distance, and image 
size to earth station pin center,large 2A if the completion of an output is received (step 46). 
[0044] In earth station pin center,large 2A, if an image, and the camera location, the camera 
angle, the focal distance and image size of image photography time of day are received in the 
communications processing section 21 from mobile terminal 1A Like mobile terminal 1A, the map 
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Research and Data Processing Department 22 accesses Map DB, and extracts the structure in 
visual field space (step 47). The structure which should appear by hidden surface elimination is 
extracted (step 48). The label information creation section 23 Label information including the 
name or its related information, and the grant location of the gained structure is created (step 
49). After the label information output section 24 superimposes a structure name or its related 
information on the location in the image corresponding to the positional information in label 
information and displays the image on which it was superimposed on a vision device (not shown) 
(step 50), it broadcasts (step 51). 

[0045] Drawing 1 3 is the block diagram of the report support system of the 2nd operation gestalt 
of this invention. 

[0046] With this operation gestalt, mobile terminal 1B has composition excluding the map 
Research and Data Processing Department 14, the label information creation section 15, the 
label information output section 16, and the image-processing section 10 from mobile terminal 
1A shown in drawing 1 , and earth station pin center,large 2A is the completely same 
configuration as earth station pin centerjarge 2A shown in drawing 1 . 

[0047] Drawing 1 4 is the flow chart showing processing of this operation gestalt. This removes 
steps 42-45 from the flow chart of drawing 3 . 

[0048] Drawing 15 is the block diagram of the report support system of the 3rd operation gestalt 
of this invention. 

[0049] With this operation gestalt, mobile terminal 1A is the same configuration as mobile 
terminal 1A shown in drawing 1 , and earth station pin centerjarge 2B has composition excluding 
the map Research and Data Processing Department 22, the label information creation section 
23, the label information output section 24, and the image-processing section 25 from earth 
station pin centerjarge 2A shown in drawing 1 . 

[0050] Drawing 1 6 is a flow chart which shows actuation of this operation gestalt. This is the 
same to the flow chart shown in drawing 1 , and step 45, mobile terminal 1 A transmits after that 
the image and related information which were superimposed on the structure name to earth 
station pin centerjarge 2B (step 52), earth station pin centerjarge 2B receives this in the 
communications processing section 21, and the image and related information which received are 
broadcast (step 53). 

[0051] Drawing 17 is the block diagram of the report support system of the 4th operation gestalt 
of this invention. 

[0052] The communication link address storage section 19 mobile terminal 1C remembers the 
communication link address relevant to a structure name to be to mobile terminal 1 A of drawing 
1 with this operation gestalt, If the location on the screen on a vision device is directed to a 
user, it will ask for the communication link address of the communication device relevant to the 
structure name corresponding to the directed screen location from the communication link 
address storage section 1 9. The screen tab-control-specification section 20 which passes the 
communication link address for which it asked to the communications processing section 1 7 is 
added, and earth station pin centerjarge 2A is the same configuration as earth station pin 
centerjarge 1 A of drawing 1 . 

[0053] According to this operation gestalt, a user can communicate with those who are in the 
structure to wish to have mutually. 

[0054] In addition, the communication link address storage section 1 9 and the screen tab- 
control-specification section 20 may be formed in earth station pin centerjarge 2A, or may be 
prepared in both mobile terminals 1 C and 2A. 

[0055] Moreover, there may not be the drawing Fig. processing sections 10 and 25. 
[0056] 

[Effect of the Invention] According to invention according to claim 1, the reporter what building 
and that whose it says it is in mobiles, such as a HEL, can understand the building out of which 
the smoke of a building called what the building in the image currently broadcast live on 
television, such as the time of disaster, is concretely and middle of the screen has come, or, 
moreover, newscasters, such as a television station which is on the ground, can understand it 
correctly in an instant. For this reason, a reporter and a newscaster look at the image 
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superimposed on the structure name, the on-the-spot live broadcast of the situation of a site 
can be carried out or can read the related information about the structure name on which it was 
superimposed, and can describe [ rather than ] detailed information (the address of who and its 
building with the exact resident of the building out of which smoke has come is **, such as 
something) about the structure. A viewer side, such as television, can also know the image 
superimposed on the structure name, and the related information about the structure name on 
which it was superimposed. For this reason, since the persons concerned are able to get to know 
information momentary with a report program, and exact when the correspondence which fights 
for time amount for a moment, such as disaster, is required, although it is after the event, it is 
useful to taking the best countermeasures against calamities. 

[0057] The same effectiveness as invention according to claim 1 is acquired by invention 
according to claim 2 or 3. I hear that the location which can superimpose a structure name is 
restricted to one side of a mobile or an earth station, and differing from claim 1 has it. 
[0058] According to invention of claim 4, further, since a reporter and a newscaster can 
communicate with the resident of the building only by a mouse click etc. carrying out the 
structure name in the image on which it was superimposed, it also interviews or they can do it. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram of the report support system of the 1 st operation gestalt of 
this invention. 

[Drawing 2] It is the schematic diagram of the report support system of drawing 1 . 

[Drawing 3] It is the flow chart of processing of the report support system of the 1 st operation 

gestalt. 

[Drawing 4] It is the data structure diagram of a scene image file. 

[Drawing 5] It is drawing showing the example (this drawing A) and three-dimension map of a 
two-dimensional map (this drawing (B)). 

[Drawing 6] It is drawing showing the count approach of visual field space. 

[Drawing 7] It is drawing showing the example of the visual field space in three-dimension map 

space. 

[Drawing 8] It is drawing showing the example of projection drawing. 

[Drawing 9] It is drawing showing the example of field division of a scene image. 

[Drawing 10] It is drawing showing the example of field division of CG image. 

[Drawing 1 1] It is the explanatory view of pattern etching of the subregion of a scene image, and 

the subregion of CG image. 

[Drawing 12] It is drawing showing the example of superposition of the label information on a 
scene image. 

[Drawing 13] It is the block diagram of the report support system of the 2nd operation gestalt of 
this invention. 

[Drawing 14] It is the flow chart of processing of the report support system of the 2nd operation 
gestalt. 

[Drawing 15] It is the block diagram of the report support system of the 3rd operation gestalt of 
this invention. 

[Drawing 16] It is the flow chart showing processing of the report support system of the 3rd 
operation gestalt. 

[Drawing 17] It is the block diagram showing processing of the support system of the 4th 

operation gestalt of this invention. 

[Description of Notations] 

1A, 1B, 1C Mobile terminal 

2A, 2B Earth station pin centerjarge 

1 0 25 Image-processing section 

1 1 Image Acquisition Section 

1 2 Positional Information Acquisition Section 

1 3 Camera Attribute Information Acquisition Section 

1 4 Map Research and Data Processing Department 

1 5 23 Label information creation section 

1 6 24 Label information output section 

17 21 Communications processing section 

1 8 Mobile Control Section 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_eije 



2006/06/20 



. .*' JP.2000-050156.A [DESCRIPTION OF DRAWINGS] 



2/2 ^— v 



22 Map Research and Data Processing Department 
26 Earth Station Pin Centerjarge Control Section 
41-53 Step 



[Translation done.] 
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W3B«LhJ8lcWf SB** 1 ^5. ZWftifr 1 StfE 
B<0Bii5B^XxAo 

&®zm\c l x n y \a a - ^ ^ 7 f >y $ xmrnx-h s 

C G BBfcmS U BffiiSBOiaiEaJiMiWKW bT/^ 
«Ji»©*#$fcttBtt1IH8*«J:tf(*^ffiB*#€J5^ 

;M»«*ffia-r*» m^b i frz 4 <ov>-rn*> 1 beb 



(3) 

3 

mm** * ?mwk 3 u 
v^igft^'i lt c g mm^im u c g mm^<o^ 
ftmmmnmic <t o t c g ®#£gi5#ft$ t #*j u 

mmzsts 7^)\sfiin*<m?z>, i *»e 4 © 
t^-f ftfr i sieeciv'T.xAo io 

[fgBJl©l¥ffl&M 
[0 00 1] 

[fgBJ3©B-f58ffi#i?] ^ii^'J^^-, fRtff 

[0002] 

mmttmnztiLm (±&$) fr&u 20 

[0003] 

U ^IEf>iT?£>&3„ fcSWi, WI^WS^ 

ttA^fcSafc^uec^^ttHPBtfclB***^**!! 
fr&Witiofr&S s J; t) fflfrvi^l/© C £ (*9# 
;M\ *©£ffi:&fci:faj&\ «*T?Ji*.-cv-5£iej£l42 

<I©fflT^5e;U©ftA«li4j&\ ^©ftA©«fS#*f 
«{5j#A\ *OftA©*«KD*»*<D«B#^tt^* 
*\ fc^ofc1^©A*fc©#iM48¥lie7*-$'*U:j? 
-2-&\M.*>lc%i%m*%;i<\ t&±<DTl>\£fm<D 

-#BW!-r*&Et»fcS. 50 
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4 

[0 0 0 4] LfctfoT, ffl©IWli, *^7t*l 
[00 0 5] 

©#* v©ffiB • as • &£Eit • mmv-fxttmm 
©#;< v<D{iB • nm - Hktmm • mmjx*mc t 

*©RU H-©£tt8^WHfe«ft£ 

m®mm\T*<D**7<DtiLW • &s • mi&eii • mm 

©fig • nm • ^ffist • h&imx*£Mu ^n^ 
sictrnyea-^ 3^«jia^rart-ec ca«^B 

[0 0 0 6] CCX\ «Ji»**0«fife<fetf*©BBa 
««©«^H:, ^i)ft©*-etfoTfeJ:V^L, iti±^© 

tf *©H3i1»*©^*ff o T»IW*7fa:«J6»«»© 
fflli3«ktf*©Hafll«©«^*fTte«:lr^5»Cil/aL 

[0 0 0 7] ?P,tC, fc««!±ja'e«IJfi**ft 

fci«aif*ffl««ii©afi7Kux*iatbT45*, m 

[ 0 0 0 8 ] 1 6 Rtiii#T-©«jg^i: C G iS#T- 
©«JB»fc©#l&{*tt©ll*** e.fc±lf ^fe^Kitt, 



(4) 

5 

mc t t c g mmttfS. u mmmmcomi^mmz 

[0 0 0 9] CCX\ C Gm&<Dft!$.&<D-mfo-O^X 

mm t mm j xzmc 3 %j&m DBtr^-trxt 
m<oimr-^^(ommK2wmmm^o * io 

ffij©«jfi»k:BnTmit*i^«r-^*SI«^^ WW* 
r-**Sfc: LTC G iSflt«iRtt#t!rr 5. 3 ^t£%0 

zmmi<D%,foZMfomx-%%o 

[0 0 10] -¥"5 Lt, /^-yv>y^y^i: < tt)MM 

<^m^mm<mm.mm. zw&mim*x*<om 20 

%xM>zm®mmKmmi%mmm\sX, warn*. 

[0011] t 1 ©aBfisas/xr 

jam mmjmtmmm^mt, wmtmtn 

<oi3^ntm^mtmm-(X^m.mt^^vm 30 
GMmm^mt. tmm&vm^ m& Lrz**7 
&wtti*7pi£ im&m t mm* * x* 1. 1 lamm 

3$jg^©£&*St#-r5Sfl 1 ©KSHflNRWl^ai:, 

mmmM®tz®mm*®m^m'£fr. mm 
±m-ty*~tt. mmmtmmmmmomsiij^y 
&.mtt)*7ftt msMk&m t mmm^ xtzmi 

m&M x*t>t ixmiffis. ®<D<px-wmm®z& 



<®m 2000-50156 
6 

* 2 (Di&mmwmz- a t . mm® LrtmmiZxmts 

mttirzm»^mwsmimtit?>m2(0y^v ym 
»*a*s&. 

[0 0 12] *»W©»2 0«i3a8S/Xri»tt»»«: 

«*w»-r *a»s»^a £ , *7&.m 

#a^ Mm&BLK.m&tmmwt&m\<Dmtt 

xm±m^y^~^mmt^m 1 ©afloat* ±ta 
&^mzmm?z&w>{m*fflW£mit$fr, mm± 
m**y*-i*. mmmtwmtmmivmzxtytii 
mtmttt^ft tmzmmMt.fmmmV'fxtz 

*©Ji»ffilW«t>»c#flEl-S«Jio*»*ll»"5-S«!! 

0itffi^s?ai:, wiaifftfc«jfi«j*ft*«fctf/* 
yyiwttaa^ai:* ±E#¥a*{pj»-r*«Lha-t> 

[0 0 13] *»W©»3 0«i$*->XrAtt, 

ft i: ftuggg fc is®-9-^ x^^tf-r § ti * ?m&mm® 

micmmi%foznmL, mmztitcwmmnmmc 
ggjcffl^-rs^'j^yitiBta^ai:, 
^^-try^-^m-r-s^ioaffl^ai:, ±ib§¥ 



7 

«Jfi»6ftKH3l-r«lKiEji«SE«Ojifi7 KbX^M 
IBiifll7Fl/Xffi1t^a*»6»«>» *46fctfffai«7 H 10 

[0 0 15] *«W©ffiOHaill»KJ:titf. tufE^ 

Mffi c g B«(t»oaj»iB«ic»*sMtt, jttisfcrttsnfc 
Cooi6] *#^©ffl©*srawfc<fcfttf* mrfe^ 20 

tc«»£«U 8L£fr&**fcV^iM&*iH*LTCG 
B&£ftfi£ U C G B£*©ffi^tt©tl»ftftK: ioT 
CGBB*aHMB«fc£aUU l»IEB«WDWB3»iMB« 

[0 0 17] 30 

xmrnmrnLxmrnz* 
[o o 1 8] 0 1 tt*«w©» i <DnmBm<D®M£m 

i/X7-l±<DMf£mX&5 0 

[0019] ^wiioffitsa^f-Aitmw 

[0 0 2 0] 1 A (GW.tf'Mj n^-) 

-T§, fiRJ^tf G P SSfttt-p&SttBflHeftfflffi 1 2 40 
fc3ft7tl?3>/^T-fe-5*^vStt1fS^gi5l 3 

0i*tfttHDB*S7W7A?***!!H1ll« 
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8 

mmmnm ex®*) KUMtz^mmm® 
i et, m%Ltc®mt, mm&m\<Dimi]*7tiL 
mtmau * ?n t mtftktmm t webbim xzm 

» i i ~ i 7 *mw?5®$)#®m® 1 8 *flt*Tv 

So 

[00 2 l] &±J§-by*-2 A ti, &IStt4g*l Afr 

mtxtvfttmmmtmmvjxz&icmmmmg. 

t}»2 4t. ±IB^gP2 1-2 5ZMWt ZVLtMty 

?-pm®2 6T**js*ftTv*. 

[0 0 2 2] ®-$1k®m%t, 'N'jn^-KGPS 
3B«i:5>Wn (3^y;U) fc**5tf«M8£ 

[0 0 2 3] fttc, *Hfitl^©«|ft*@3©Mn0K 

[0024] ^Bj^ffl* i A©fRR^s s-rsaws 1 8 
ssi 2, tjtym&mmm&i 3, BBustftssi 1 

t»bT«yiB«63vyK*SS5 0 ffiBBBIR&flS l 2 
H\ MffiR 1 8 T GPS SBflWtc «fc K> 

mmmsmimu wm\ s\m? i 
Do ccx\ $fMmmim&mmt>?z<D£5tct 

oTt±K BflHMtttl His M^l 8^6f8^* 
r-y74 1) o #^«1£1i$BIRf#gl5l 3(±, $ij®ai5 1 

B«D*^5ft%*¥ftfcfflift©aT«lffb 

1) v |lP^cX-AaH6£«-f3S&B&gBT-&fttf 

«isa®B*Bi»-rs (xf7/4 1) c Hflw-wxan 

SBS^B«KB^*©-P, SiJSJgPl 8^B^^X1f 

[0025] 04«, mwmmyrJjUDT-fffi&tD 
mmT-^n-Dc ^vftimtLxn, w * 



9 

m m mstQ&T-? (.mm, xm 3 7^5 

5#1 0#, :it*t3 4g3 4#3 0#, ttffil 0 1 m3 
3cmf) fcfrfSo **5fti:LT, 7j<¥ft£ffl]ft© 
(tHfctf, 7k¥ftfe@D 2 5 4fi, fflft 1 5g 

mt lt. a^^o^j aw*tf, b*b*hi 1997^ 

1E3 1 Bi 5B*6#i iwm Zftio ffl&7rf;l/ 
©H«tfMXfcLT\ «*t©H*1MX 6 4 

0X48 OH) ^rifOo IrIU< 77^ (T I F 10 

/WHS (30 7. 2KBH) *JfO. iSttr-**© 

[0 0 2 6] f&JftJgtf 1 8tt*«SI«7r>f A/**»-r* 

So H^SOSgPl 0-PB, *SiWC**.tf*«iHW3© 
««M*»cl»iMBll*fT-3rlllWI*iiliau ^©fl 

T?*»«©»iffl*?T 5. :©i: %m&m<Dwm& 1 b 

HTfeD, (tJUHttMBbT^Si^frs. *©fc«> 

Kmmtymzft^x, mm 1 B*oau6bfc»*» 

[0 0 2 7] ff&nfciumtti(ttotftttilfc#*~ ft 
^otf^cDtfea^oR^wwoafcttOx ««*©ii 30 

Gfi*) ©R**»AU tt*Wm^*»©«H* 

[0 0 2 8] fiPJIPffi 1 8 tt£tfliBtt©ffilg#iiJ&3«% 
fflSSW. *B1»«81»l 40Wam J6B 40 

0»xt£> ^M©2&7ET-*T*&5&5i®££, ££# 
T*©*M©K**i§£U 2*7CT-*fc«i£bT* 
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10 

fc*£*£ti!f**»c 3 &7CT-**m8*S 0 C 3 b 

[0 0 29] 3 #73ftHr-* ©W&H 5 tiR"*-. 0 5 

(1) fc2 2fc7CT?*SLfcttH«*£ffl*jSU 05 

(2) K3*7Ct?aSbfc«!H1WBffiW*^"r. CO 3 
*7C*H«iaa!lBK»tT, iiilPgfMRVSVl 4T'(i©J 
TO 1 8 ©*fr*»*T«IHMfc7 7 4 iwy\ v 
*mK$mgm*Wtii?% (Xr-yX4 2) . 06 CM 

7c«s0i»ai^w©*T^-r5. mx.& mm 3 7^ 

5 5#1 9», ;lti&t3 4g3 4#3 0#, ffff 1 0 lm 
5ft ««*©*¥& i: Wft *»lc * * 5ft *lRl*K£-r 

■nB©xMre©Sx*R£u awiRic-tNfXfr&Ytt 

■e©«y*Rj&*-*. WxttEy OTiSfcttHl**^^ h 
;Wc#bT#*5ft73ftfcSfiT\ *OJ||j«F**«TJ: 
5tcBteS<xSo SjSE ^5Bffi© 4 H© 
j«fc*t84fiffiR*#«#©, feSE*»6Sltf«4*©* 
ilD»j!WS 335?7E2IHI*a»2!iafc-rS. B7t, 3# 
7C%B£MT©1S»£lfl©B!l*jS*. 3*7C*H^H* 
XZ¥S^5.^a6rcfe©t ; a55o H7Kf«8HSTHSn 

fcffS-saBfffiiwcii-rsamio* xz¥ffiT-©»fffiia 
nri/^So 

[0 0 3 0] Set, JttEtitffiWggfll 4T*«, *i6fc 
S»Sffl©*fc#aEl-**3B»**i&*. «fiW5lc, 

M«fc#fi-rs*^*^w-s-rso aiS2*7afiHami 
ti-^-»7--i'X©2#7c^-y->a-eK^je.nr^5o 3# 

7C*H$IH©^*y'>a©«*)*i:tra:, tKW©2#7£ 
F^©S^%*i6i>o C c 3 *7C*ffi*HffillD©# 

i«T*]iusi©«*i:ajS©*«i:*e4saai**«>, * 
©itti^B 8 ©* * ?ww\ctt l x&M&nois. im 



(7) tfM 2 0 0 0 - 5 0 1 5 6 

11 12 

[0 0 3 1] «Ji»*miF$MOrtaPK^Sn*^ £ P*£* ^WBKaKLT^Q****. 

fett*©H»^sn*«^, #*5fflffi£*S&ffii:L [0 0 3 2] 

T, ^Stit^S: C OJJWBlc 3 VO&W&fr 5«MJc [ft l ] 
A5 0 tct\ B8fc«fJ:5K, AP**S'(l) ** 



n / ^ T ° 



x - ex-h ixt 1 
y - ev + lyt | • • • c i > 
Ix ly Lz/ \z-ez+Ut 



(?)-2J(?) 



j6p= (x. y, z) : ffim«ilA-r«]IUKoiM 
j&E=(ex, ey, e z) 

^h;i/L=(lx. 1 y, 1 z) : fflffifa^ hfr 
(*{<K* h/V) 
jSP' = (x* , y' , z" ) : jStPOtSjSE*SfcU 20 

r = ( 1 x + 1 y ) 

4£Q = (x, y) : £P<D#*9BSK\©ia&jS 

t afu^at 

jStfSSIi****. mar, i»>tt?-«3!£ft&«ii 

mm czfflD ttT^tut«»-r*. #^it^© 30 

&ffi«tc, **7BB±©£BBfc*M-<&JlfT*fit (z 

ffi) mwu ^*ut««if*o a* (s) if© 

z 1 ttftjSfr&OAfr** (Zffl) ^S-To 

[0033] a * ymmic 3 wvmrn&z. titcmma 
3) o Hffisaao^stfi, v-^ssstf, mar z 

/^77tt*ffiV>«. fll!OX*-y>7l'>a, ftSBiBfr 40 
[0 0 3 4] A^BSLkOBB&ffitlCfcoT, *© 

n« 0 **5Bffi±©£Bfli§K:&j£k:g i kifi^i5tfi* 
B*ttHRttfc»W«JWl-rs©-p, **5B®T-a, 



[00 3 5] C 5 LTT?#fc«tttf , C G Bftffitt«$ 

So 

[0 0 3 6] CGH«S«*«JS-r5 2#7cHJ&©K£ 
■ ffi«fc»tT.-ja»««tW03 3fc7cS«l**«), B#© 

[0 0 3 7] H»»SbTg|ofe»r-**»i:LT, 
C GHft^BK^MfS. 3*7cttHDB**!lfflLTV> 

fWtTl><. C GB«*a»0»iMB*K»»JUfe 
0|J£0 1 0 fc^-To 

[0 0 3 8] CGB«©«tt#*J^tf£7Lfc&, M 
IWl 8tt5^HIH8fflSWl 5fc*tLT, C GB*£© 
5»J««i: ^BB©#*J««©»J6ttW-*fr 5«t5E 

Ws. 7^;Hf ffltf&B 1 5T-«, fy/whv 

«0»«f«Ht*fi3 (Hi 1#RD c 
[0 0 3 9] SftBft©fttJfM©*-&* 

is (mar, is) ^&«jccGB«©»»JtB«i:Jt« 
%o mar, mmmmvftmmmi §s©r 1 fcwt 

T, ?<Dffi«rtK:$3&B£4>i£aKg£ (A, B) fcf 
<E><> MWi (A, B) T*©BiPt©Ma, ««©rt»«>*fc 
1 T-fcSo C GB«© 1 *g<D#9JfiMES 1 K43t>T, 
£ff (A, B) «<B«S 1 rtft6tfffi«ll 1 T-%>K>m. 



(8) 
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13 



14 



LXm (A, B) -C0fifc»)«ftK (A, B) £L 

(A, B) «ffl#R 1 m%9&$tlK 
(A, B) £}£i65o ^LT, WMR 1 frtfHfrLfea 
fll (A, B) «MRNlt»LT, S&OtlifcK (A, 
B) 1 T?fcofc**©»N 2*#«>T\ N 1 /N 2tf 
LSHIJilhTfc**^ MB1ft0£HHimR l i: 
CGHftCD^fMHCS lffttl&?Z*><D£frtbZ 0 C© 

tt&m*mwm&<D#$m®<D 1 #gfre>«&©&© 
ipjtc^>©fts-rn*^o t t> ra cukc** «* ? 

[0 0 4 0] 7"WWWft*» 1 5?tt, flHMkOflS 
4MB«fc»UT C G®«©»^»&#«tttf fc& S 



* © 3 3fc7C«IJfii*lO»*ia** ^ vBffi^tt LT 3 

£&©gfcfcofc3&7t1?lii!Kj©ffi£, CGB#©g|5# 
flWW8o*fr*ffl[ (Zffi) fcLT**So Jfcfc 
3 ^i^g«lLfclRK:fft*LT*5^fc U fB£* 
-KLTt»«tV>. &fc£&o£#fi£tl©ffl£&£tC, 3 
#7ctf!B D B 1 7 LT*®#iai*©£*i: fcttM 

tittbjm, 2©J:5lcfti6TfeJ:v\ 09*. tf, 

So $ 1 £^;Hf$g©0!l£*to 
[0 0 4 1] 

mn 





SStitit 






(3 0 0, 5 0 0) 


1 0 




(4 5 0. 2 5 0) 


1 0 




(1 5 0, 2 0 0) 


1 2 



[00 4 2] MtPS 1 8 fci\ 7^M»«*S»«f 5 1 , 30 

5) o m^^mmtfmmztitcmmmmomz* 

[0043] 7^mnm®i 6«7^;Mtai*ta^ 
t^t, tMj£7*M»as 1 8fca»rrs. ftdtpffii 8 40 

sggi t mm 4 x*m±.m*. yz-zh ^mm? s «t ? 
K&*t& 6) „ 

[0044] m±.m*zy*-z at-h, &sbtttti£i a 

®wm i a * r«(c lt, ussm ffiwggu 2 2 #«h 

DB£7**XLT&g£flS4>©«»£ftJtijL Ur 

•y^4 7) , v&w$m\c£')&z.zit?<DmmiztA& 50 



&5"W1*«*f&aL Uf7^4 9) , ^HMRffl 

0) „ mm?z> (xf7/5 1 ) o 

[0 0 4 5] 01 3tt*fSH©E2©H«JB8©«it£ 
^>7.x^©Mfi!t0T*fe5o 

[0 0 4 6] ^Hfl&JfcJgT'ti, &fM*JN* 1 BfiB ltC 
jSLfcSftfttB* l A^BifiHUHROTS 1 4 

«Hiffj«a5 1 5 k ^frmmm® 1 6 tisii^agp 1 
ozmvcm&tKvxis*), m±m-ty*-2 Aim 

1 tc^bfc%±^-tr>^-2 A t-k< RC«fiKT-*5. 

[0047] 014 tt*n*«i&oii!yi*^rawiH7 

fe5o iiniii3©7a-f+-h*^xf'yy4 2~ 
4 5^l^l/^fcfe©T*feSc 

[0 0 4 8] 0 1 5tt*!BB0»3©£M««©fHil5: 
S->7.rA©«fi!t0T*feSo 
[0 0 4 9] *Hfi(B»ffiT-tt, 1 AUB 1 K 

-2 B(±0 1 K^bfcift±J8-fe>*-2 A*»&JfiHiIia 
WSSI5 2 2 fc5^H»«fflS»2 3 fcv^UfStB^SP 



15 

[0 0 5 0] 0 1 6tt:**to*»©ftft*jjVr:7n-*- 

f>^4 ssrwe, =t<D'mw)fc%&i a a, 
ft*ffl«*!JH»2 it»»bu gMtfcWk wmm 

*tm?Z> (Xt^75 3) „ 
[0 0 5 1 ] 0 1 7 tt*»9J©$ 4 ©HfiS^fi©l8>I3: 

[0 0 5 2] *HflS»irt?tt, &®>ft$* 1 CttH 1 o 
l Ate, «RNfeftftlcKtrsHt7 FUX 

UX*aMl7KU*3B1f»l 9*»6*», #«>fciHB7 

f uxttmmmmt® 1 7 tattiSffiffiint^gB 2 0 mt 
[0053] *n«s«siic<tn{f, *ufli#tt»s-rs* 

[0 0 5 4] fcfc, iHI7 KUXiBttMB 1 9 tHffiftfi 
Jt£»2 0tt*lLhJ8-fe:/*-2Afc:HtfTt>, IMMtfl 
* 1 C t 2 A©W£fc»ttTt> «fcV\> 

[0 0 5 5] SMMSBl 0, 2 5«&<T ! E>J: 

</\. 

[0 0 5 6] 

^ 5 WlIT** *\ MX. Bffif *©*!# fflTi^ 3 
fift tr t *\ v > c £ u n 7# -m<D&®fcic 

■e«Bfi»icBB-r*«fcOiafflftiMi (mar, mmr^ 

4) fciS^fcOT***. rues©«)»f©flfc, MS 

ateffoMMSftfciftft^ ft£?nfcK&ft«fticH 

tt**tffl»©»«^*i:S©fcSiK>. 
[00 57] 2 £ fcli 3 (cGaOAniC «t o T 

&ffi#frifc±/i©-73 ICR 6 ft 3 ^ 5 C t X'h 5„ 
[00 58] 9l««4©«WlC«tfttf, ££KU*-* 



(9) tfH 2 0 0 0-5 0 1 5 6 

16 

[0ffi©jfflJ|iftiKE] 

[0 1 ] *«WOJB 1 ©IIS&«fg©$gjI»>7xxA© 

4S$0T?&3 O 

[02] H 1 0«J8i»'>XrA©««H-P**o 

[03] is i <DnM&m<D^%&*XTi*<D9m<Dm 
io ft0-efe§ o 

[04] «W8«7rW , ;Vc07*-^«IJ6HT**. 
[0 5] 2&7ttt!0©0IJ (RHA) ) ^©3#7Gi&0 
mm (B) ) 

[06] SHPawoiw*s*^-rH-e«So 
[07] 33tfc*H£H-e©is»2ra©M*^rBi'e<& 

[08] si?H©ffl**?H'efc«. 

[09] *ws«oifi«»«iJiw**"rH-e*a. 

[010] CGBft©M*^ffl**-*-B'P&S. 

20 [011] *Mft©fls£WKfc c g a^©gp^ffi^© 

[012] fH^§K\©^;Mi$g©M©fiaj£^-f0 

[013] *58WO»2©H«0BI8OfBi8Sas/^7 L ix 

[014] ^2©^^©«ai5:g^XxA©^a© 
fitft0T*fcS o 

[015] *SMB©»3©iaiHPI!i©«at$«^XrA 

©«lfig0-e^Sc 

30 [0 1 6 ] m 3 ©H«0B«©«aR«^X'r A©«!3i* 
^-r«tft0T-&-5„ 

[017] *«W©S4©*SWBII©3ai^X'r2»©«i 

a*^-r«^0T^5o 

[ft*f©iB$] 



1 A, 


1 B, 1 C gftftffi* 


2 A, 


2 b ttujs-ty*- 


1 0, 


2 5 sflMo&ft 


1 1 




1 2 




40 1 3 




1 4 


mmmmm® 


1 5, 


2 3 7"<;wi«ma» 


1 6. 


2 4 7^M»«lH*» 


1 7, 


2 1 iHiaaggB 


1 8 




2 2 


®mmmm& 


2 6 




4 1 ~ 


5 3 Xr-y7 
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